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REAL DOUBLE COSET SPACES AND THEIR INVARIANTS 

ALOYSIUS G. HELMINCK AND GERALD W. SCHWARZ 

Abstract. Let G be a real form of a complex reductive group. Suppose that we are given 
involutions a and Q of G. Let H = G" denote the fixed group of a and let K = G^ denote 
the fixed group of d. We are interested in calculating the double coset space H\G/K. We 
^-^ ' I use moment map and invariant theoretic techniques to calculate the double cosets, especially 

f^ , the ones that are closed. One salient point of our results is a stratification of a quotient of a 

CsJ ' compact torus over which the closed double cosets fiber as a collection of trivial bundles. 

t^^ ! 1. Introduction 

\ Let t/ be a compact connected Lie group and let Uc denote its complexification. Assume that 

f— ( ' we have a real form G of U^ with corresponding real involution ip which preserves U . Assume 

P^ . that we have holomorphic involutions a and 6 oi Uq, commuting with (f, such that they generate 

r^ ! a finite group of automorphisms of the connected center of Uc- Let H be an open subgroup of 

'^ I C^, the fixed points of a, and let K denote an open subgroup of G^. We are interested in the 

C ■ space of double cosets H\G/K. As in [Mat97, §2] one can reduce to the case that 

' ': (LO.l) G = HG^K. 

cn ■ 

>■ ' For most of this paper we will assume that K = G^ and explain later how this assumption 

^ ■ can be removed. Then, as in our previous work [HelSOl], we identify G/K with a submanifold 

f^^ ! A of G via the mapping g h^ (5{g) := g6{g~^). Via this identification, the H action on G/K 

cn I becomes the *-action on X where h * x := hx6{h)~^, h & H, x & X. We show that there 

'sj" ■ is a quotient X//H parameterizing the closed orbits (then one can, in principal, determine all 

^ . orbits). We can assume that the Cartan involution 5 of Uc commutes with a and 6 (§2). Let Go 

(^ ! denote G nU. Using the results of [HeiS07] we define a kind of moment mapping on X whose 

^ I zero set Al is i^o •= {H fl t/)-invariant and has the following properties: 

'k>( I • An orbit if * x is closed if and only if it intersects Ai. 

^ ■ • For every x G A, the orbit closure H * x contains a unique i/o-orbit in M.. 

• The inclusion M. ^ X induces a homeomorphism Ai/Ho — X//H. 

Now Ao := /3(Go) C Go has the *-action of Go D Hq. Let A be a (connected) torus in X. We 
say that A is (cr, 6')-split if a{a) = 9{a) = a~^ for all a E A. Now let Aq be a maximal {a,9)-sp\it 
torus in Go (so ^q C Aq). Then it follows from [Mat97] (cf. Theorem 4.6) that there is a 
finite Weyl group Wq acting on Aq such that the inclusion Aq — > Ao induces a homeomorphism 
Aq/Wq ~ Xq/Hq. The idea is to try to find a similar result for the i^Q-action on Ai. 

Let x e A. Then there is a natural submanifold Px of A which is stable under conjugation 
by Hx such that PxX is transversal to the orbit H *x a.t x. If if * x is closed, then an if^j-stable 
open subset of PxX is a slice for the action of H. Moreover, P^ is a symmetric space for the 
action of Hx- We say that x is a principal point if the action of Hx on Sx '■= T^Px is trivial. Let 
= 00 © ^0 be the Cartan decomposition of g. If m G Go, then Su is 5-stable and decomposes 
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into a compact part Su H Qq and a noncompact part iS^j fl to- There is a natural ifo-equivariant 
surjective map tt : 7V1 -h^ Xq where the fiber of ir above m G Xq is exp(iStt fl to)u. Thus M. fibers 
over Xq with fiber over u the noncompact part of the transversal at u. We show that there is 
a natural and finite stratification of Aq which is iyo*"Stable such that the mapping vr is a fiber 
bundle over each stratum. This in turn implies that X//H ^ Ai/ Hq is a fiber bundle over the 
images of the strata in Aq/Wq. If u lies in a stratum 5* of Aq, then the fiber over the image of 
5* in Ao/Wq* is exp(5„ fl Xq)/{Hq)u. Moreover, for any maximal a-split commutative subspace t 
of Su n to there is a finite Weyl group W{S, i) such that exp(5 fl Xq)/{Hq)u ^ exp(t)/'W^(S', t). 

There is another way to parameterize the quotient X// H . Let u (z Aq and let A be a 5-stable 
maximal (a, ^„)-split torus. Here 9u denotes 9 followed by conjugation by u. Then Au C M.. 
We say that A (or Au) is standard ii Ar\U = Ar\ Aq. We say that maximal (a, 6'„.)-split tori 
AiUi, i = 1, 2, are equivalent if there is an /i G i/ such that h * AiUi = A2U2- Then we show 
the following: 

• For each stratum of Ao/IVq* there is at most one associated standard maximal Au. Let 
{AiUi\ be a maximal collection of pairwise non-equivalent tori coming from the strata. 
Then UiAiUi — > X//H is surjective. If x is a principal point, then H * x intersects 
precisely one of the AiUi and Px is a maximal (a, ^2:)-split torus. 

• If AiUi and A2U2 are standard maximal, then they are equivalent if and only if there is 
a.w eW^ such that w * {AiUi fl Aq) = A2U2 n Aq. 

• If A is a maximal {a, ^u)-split torus, then the group of self-equivalences of Au is a finite 
group. This group acts freely on the set of principal points of Au. 

This paper is a natural follow up to [HelSOl] where we considered the problem of determining 
the quotient G'^\G/G^ (the complex case, or more generally the case of an algebraically closed 
field of characteristic not 2). Our techniques were those of invariant theory, i.e., slice theorems, 
isotropy type stratifications, etc. We also used these techniques here. The new ingredient is the 
use of moment-map techniques from [HeiS07]. The moment map techniques have also been used 
in a recent paper of Miebach [Mie07] who works in the setting of Matsuki's characterization of 
the double coset spaces. The main novelty of our results is the use of stratifications of Ao/VKq* 
which help in determining the topological structure oi X//H. Also, our arguments are somewhat 
simplified since it is only the action of the group H which is being considered. 

We thank the referees for helpful comments. 

2. Cartan decomposition, Kempf-Ness set and the quotient 

We now show that one can assume the existence of a Cartan involution commuting with a 
and 6. 

Proposition 2.1. Assume that q is semisimple. Then there is a Cartan involution 6 of q such 
that 6 commutes with a and 9' where 9' differs from 9 by conjugation by an inner automorphism 
ofQ- 

Proof. There are Cartan involutions 6 and 6' of g which commute with a and 9, respectively. 
Moreover, 6 and S' differ by conjugation by an inner automorphism of g [Hel78, Ch. Ill, §7]. D 

Let conjugation hj g E G he denoted by conj(5f). 

Corollary 2.2. For some g & G^ there is a Cartan involution ofG commuting with a, conj(5f) o 
9 o conj((7)~^ and the involution ip defining G <Z Uc- 

Proof. We may write Uc = {Uc, Uc)Z{Uc)^ where Z{Uc) is the center of Uc- The two compo- 
nents of the decomposition are preserved by a, 9 and (p. Since Z{Uc)^ has a unique maximal 
compact subgroup T, it is preserved by a, 9 and ip. From Proposition 2.1 we may assume that 
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we have a Cartan involution 6 of (g, g) which commutes with a and 6. From 6 we obtain a con- 
nected maximal compact subgroup U' of {Uc,Uc). Then U'T is a maximal compact subgroup 
of Uc which is a, 9 and (/^-stable, hence the corresponding Cartan involution of G commutes 
with the other involutions. D 

Remark 2.3. Changing 6* to a conjugate automorphism as above only changes the double coset 
spaces we consider by an automorphism [Mat97, §1 Remark 2]. Thus from now on we assume 
that we have a Cartan involution 5 commuting with a, 6 and ip and that {UcY = U. It is not 
hard to show that, if a and 6 commute, then one does not need to replace ^ by a conjugate to 
find a suitable S. 

In the following, let G, H and K be as in the introduction, where K = G^. From 6 we 
have the eigenspace decomposition g = 6 © p. Similarly, for a we have g = f) © q. Let 
P := {x E G \ 6{x) = x~^}. Then G acts on P via *; g, x ^-* g * x := gx6{g~^). We set 
Pig) = g * e ioT g E G and we denote /3(G) by Pe{G) or X. Then f3 induces a bijection of G/K 
onto X. We will now see that X is smooth, and it follows easily that j3 is a diffeomorphism. 
Under the diffeomorphism /3, the left action of H on G/K becomes the *-action on X. 

Lemma 2.4. Every G-orbit in P is open. 

Proof. Let x E P and consider the open set of points exp(t')x where v lies in a small neigh- 
borhood of G g. Then exp{v)x lies in P if and only if exp(6'(f))^(a;) = a;~^exp(— i;) which is 
equivalent to the condition that 6{v) = — (Adx~^) ■ v. Now let w = v/2. Then 

exp('u;)xexp(— 6'(ii;)) = exp{w) exp((Ada;)(— 6'(u;)))x = exp(t;/2) exp(i;/2)a; = exp{v)x. 

Thus G * X contains a neighborhood of x in P. D 

Corollary 2.5. Every G-orbit in P is closed and is a smooth suhmanifold. In particular, X is 
a closed suhmanifold of G. 

From our Cartan involution 5 we have the Cartan decomposition G = Gq exp to where Go = 
G r\U and g = go © i^o is the Cartan decomposition of g. The involutions a and 6 preserve Go, 
go and to. Set Xq = Pe{Go). 

Proposition 2.6. Let Go, etc. be as above. Then Xq = X CiU. 

Proof. Suppose that x E X n U, x = /5(uexp(f)) where u E Gq and v E to. Then x = 
u * /5(exp(u)). Thus u'^ * x = /5(exp(w)), so that we may assume that x = exp(f ) exp(— 6'(f)) 
for V E Xq. But then a;exp(6'(t;)) = exp(w) and uniqueness in the Cartan decomposition forces 
X = e. Thus X E Xq. D 

The proof of Lemma 2.4 also gives 

Lemma 2.7. Suppose that x := uexpiy) E X where u E Gq and v E Xq. Then 9{u) = u~^ and 
9(v) = -{Adu)v. 

Corollary 2.8. There is a G^-equivariant projection X: X ^> Xq, Mexp(t;) !—> u, where Gq is 
acting via *. 

Proof. Let x = uex]){v) G X as above. Then u E P. By assumption (1.0.1), Hq acts transitively 
on the components of X, so we may assume that there is a path from x to e in X, so that there 
is a path in P fl f/ from u to e. Since Xq contains the component of P fl ?7 containing e we have 
u E Xq. If u' E Gq, then u' * x = {u' * u) exp(Ad6'(M')t') G X where k(\9{u')v E Xq. Thus A is 
equivariant. D 

Remark 2.9. There is another way to view A: X — > Xq. From [HeiS07, Theorem 9.3] there is 
an isomorphism Go x-^^ (p fl to) — G/K, [u, i]^^ u exp(^), where Kq = K \^ U. This gives us a 
Go-equivariant map G/K -^ Gq/ Kq. Applying (3 one gets the mapping A. 
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2.10. Conditions on a and 9. Our assumption on a and 9 is tliat tliey generate a finite group 
of automorpliisms of Z{U)^. This assumption is related to that of Matsuki [Mat97, §2]: 

Proposition 2.11. The following are equivalent. 

(1) The subgroup o/ Aut(Z'(f/)°) generated by a and 9 is finite. 

(2) The image of a9 in Aut(Z'(t/)°) ~ GL(ri, Z) is semisimple with eigenvalues of norm 1. 

Proof. Clearly (1) implies (2). Now assume (2). The image of a9 in Aut(Z(f/)°) ^ GL(n,Z) 
has eigenvalues that satisfy a monic polynomial equation with integer coefficients. Since the 
eigenvalues have norm 1, they must be roots of unity. Since a9 is semisimple, it follows that a9 
has finite order. Thus a and 9 generate a finite subgroup of Ant{Z{U)^). D 

Lemma 2.12. There is an inner product ( , ) on u which is U, a and 9 -invariant. 

Proof. Write U = UgZiU)^ where Us = {U, U) is the semisimple part of U . Since Aut([/s) is a 
finite extension of the inner automorphisms Int Us of Us, we find that a, 9 and Us generate a 
compact group of automorphisms of u^, so that we can find an inner product invariant under 
this compact group. Since a and 9 generate a finite group of automorphisms of 3(u), it has an 
invariant inner product. Putting the two inner products together gives the desired result. D 

2.13. Moment mapping and Kempf-Ness set. We have the Cartan decomposition f/c — 

f/ X m ^ f/ X exp(zu). Let ( , ) be an inner product on u which is U , 9 and a-invariant. We 
also consider ( , ) to be an inner product on u*. The function p: Uc —>■ K, p{uex]i{iri)) := 
(l/2)(?7,?7), u E U, rj E u, is a. strictly plurisubharmonic exhaustion of Uc (see [HeiS07, §9]) 
and it is invariant under left and right multiplication by elements of U. Associated to p we 
have a Kahler form u = 2iddp and a moment mapping u: Uc ^ u*. li g E Uc and ^ G u, 
then i^{g){^) = ■^\t=op{gexp —it^). Note that u is f/-equivariant, where U is acting by right 
multiplication on Uc and u E U acts on u* by a i— ^ a o Ad{u~^). Let u^ denote u followed by 
evaluation at ^ G u. A computation [HeiS07, Lemma 9.1] shows that u has the following simple 
form: 

(2.13.1) i/«(uexp(zr/)) = (e,r/), ueU; ^, rjEu. 

Thus u is, essentially, projection of Uc — U x iu c::^ U x u* onto the second factor. Now we 
consider the action of U on Uc given hj u * g = ug9{u)~^. Note that p is still [/-invariant. 

Lemma 2.14. Let U act on Uc by * and let p: Uc ^ u* denote the corresponding moment 
mapping; p^{g) = f^\t=op{exp{it^)g exp{-it9{^)) . Then 

p^iuexp{i7])) = (r/,^(0 - Ad(M-i)(0), ueU; r], ^Eu. 

Proof. The product rule shows that 

d d 

p^{uexp{iri)) = —\t=opiexp{itC)uexp{iri)) + —\t=op{uexp{ir])exp{-it9{^))) 
dt dt 

where by (2.13.1) the second term is {r],9{$^)). Now 

p{exp{it^)uexp{ir])) = p{uexp{it Ad{u~^)^) exp{ir])) = p{exp{it Ad{u~^)^) exp{ir])). 

Let ( denote Ad(M~^)^. Write exp(i?7) exp(— it(^) = u(t)exp{ij(t)) where u(t) E U and ■y(t) E 
u. Then p(exp(zr/)exp(-ztC)) = l/2{j{t),j{t)) and by (2.13.1), ||,=o(7(t),7(i)) = (^,0- It 
follows that 

p{exp{ttOexp{-ir])) = p{exp{-i-f{t))u{t)-') = l/2{-f{t),-f{t)) 

and that 

— \t=op{exp{it^)uexp{ir])) = (-//, C) = (r/, - Ad(n-^)0. 
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D 

Let X := ue:>cp{irj) G X where u & Gq and t] G iVq. By restriction, the moment mapping /i 
gives us a mapping X — > u* — >• (if) fl u)*, which we also denote by /i. Then /i is the relevant 
moment mapping when one considers the action of iJ on X (see [HeiS07, §5] and §2.15 below). 
Let A1 denote the Kempf-Ness set, i.e., Ai = {x & X \ fi{x) = 0}. From Lemma 2.14 we see 
that 

M C {uexp(i?7) I 6'(?7) — Ad(u)?7 ± ii) H u}. 

From Lemma 2.7 and Corollary 2.8 we have u & Xq and 9{r]) = {— Ad u){ri) so that 29{ri) ± 
if) n u. Now ig = if) © iq so that the perpendicular to if) fl u in ig fl u = ito is iq fl u. Thus when 
uexp{iri) G A^ we have that 6'(?7) G iq fl ito. We finally get that 

(2.14.1) M = {Mexp(C) I M G Xo, 6(0 G q n to and ^(C) = -Ad(M)(C)}. 

2.15. The quotient. Recall that Hq = HnU. Since the moment mapping comes from a strictly 
plurisubharmonic exhaustion, from [HeiSOT, 10.2, 11.2, 11.15, 13.4] we have the following result 



Theorem 2.16. Let x E X . Then the orbit closure H * x contains a point xq of Ai. Moreover, 
H * X {~\ J^ = HqXq is a single Hq- orbit. 

We now define an equivalence relation on X by x ~ y if the corresponding ifo-oi'bits in Ai 
coincide. We define the quotient X//H to be the set of all equivalence classes with the quotient 
topology. From [HeiSOT, 11.2, 13.5] we have 

Theorem 2.17. The inclusion Ai — > X induces a homeomorphism Ai / Hq ~ X//H. The closed 
H -orbits in X are precisely those which intersect A1. 

3. Transversals and the slice theorem 

Let X G X. Let 0^. denote conj(x) o 6 and let t^ denote O^c. Then 6^ is an involution of 
G. Let G*^^^ denote the fixed points of r^.. Then conj(x~^) and t = 9a are the same on G^^^ 
as are a and O^. Moreover, G^^^ is a and 6'x>-stable. Note that G^^^ is not necessarily reductive 
(see Corollary 5.3 below). Let S^ denote {Z E Q \ 9x{Z) = a{Z) = —Z}. Let P^ denote the 
component of Pe(G^^^) containing e. Let p*^^^ denote {Z G Q \ 9x{Z) = —Z} and let l^^^ denote 
{Z e g\ e^i^Z) = Z}. Then g = 6^^) © p(^). The subgroup of G^^') fixed by a is just H^, the 
isotropy group of H at x. 

We say that a locally closed Hr^-stable smooth subset Qx of X is a transversal at x if T^iQ^) 
is a complement to Tx{H *x) in T^X. The following theorem generalizes the results in [HelSOl]. 

Theorem 3.1. Let x G X. Then P^x is a transversal to H * x. Moreover, Te{Px) = Sr^ and 

Te(ifj = e(-)nf). 

Proof. We have the smooth map tp: G —>■ Xx~^, g ^-^ {g * x)x~^. The differential dtp of ^ at e 
sends Z E Q to Z — 6xZ. The square of dip is 2d'ip, so that dip is (up to a constant) a projection 
of g onto Te(Xx~^). Now dip{l)) is the tangent space to {H * x)x~^ at e. The kernel of dip is 
i^^\ so that p*^^-* is complementary to the kernel of dip. In fact, dip is multiplication by 2 on p^^^ 
Thus the Lie algebra of Hj. is f) fl t^^^ and the complement to T^{{H * x)x~^) in T^{Xx~^) is 
#(q n p(^)) = q n p(^) = Sx. Now T.P, = {Z e g(^) | a{Z) = -Z} = {Z G q | O^^Z) = -Z} = 
Sx- It follows that PxX is a transversal to if * x at x. D 

From [HeiSOT, 14.10] (see also [HelSOl, 2.7]) we obtain the slice theorem. 

Corollary 3.2. Suppose that H * x is closed. Then there is an open Hx-stable subset S 3 x 
of PxX which is a slice at x for the action of H on X . In other words, the canonical mapping 
H x-^^ S ^ X , [h., s\^^ h* s, is an H-equivariant diffeomorphism onto an open subset of X . 
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We now compare the transversals along if -orbits. 

Proposition 3.3. Let x e X and let he H. Then conj(/i)(G(^)) = G^'^*^) and conj(/i)(P,) = 
Ph*x- Thus h* (Pxx) = con}{h){Px)h*x = Ph*xh*x, hence h carries the transversal at x to the 
transversal at h* x. 

Proof. Let g E G^^\ i.e., assume that Tx{g) = g. Then 

Th,x{coni{h)g) = hxe{hy^e{h)T{g)e{hy^e{h)x~^h~^ = hxT{g)x~^h~^ = coni{h)g. 

Thus conj(/i)G('^) C G^^*^^ and similarly conj{h~^)G^'^*^^ C G^^\ so we have equality. It follows 
that {ga{g)~^ \ g E G^^^ is sent by conj(/i) onto {ga{g~^) \ g E G^'**^)}, so h maps P^x 
isomorphically onto Ph*x{h * x). D 

By a torus in X C G we mean a connected commutative group of semisimple elements. Thus 
M* is not a torus for us, but its identity component is. Now as above, we have the following 

Proposition 3.4. Let x E X , let h E H and let A be a (a, 9x)-split torus in G. Then con]{h)A 
is (a, 9h*x)-split and h * (Ax) = {con}{h)A)h * x. 

Definition 3.5. We say that x G X is a principal point ii H * x is closed and the slice 
representation at x is trivial, i.e., H^ acts trivially on Sx- We say that x G A^ is principal if it 
is principal in X. 

Remark 3.6. If x is principal, then the slice representation at x must have dimension dimX/fH 
which is the same as the dimension of a maximal (o",^)-split torus in X. But this is the same as 
the dimension of a maximal [a, 6'2:)-split torus in P^, hence Px must be a maximal (a, ^2;)-split 
torus. Finally, it is well-known that the principal points for the iia;-action on P^ are open and 
dense, hence the same is true for H acting on X. 

4. The compact case 

We first need to compute the quotient of Xq by the action of Hq. This is in [Mat97, §3], but 
we need Corollary 4.5. A variant of an argument in [HelSOl, 6.7] gives this result. 

Let Aq be a fixed maximal (cr,^)-split torus in Xq. Set Wq = Nq/Zq where Nq = {h E Hq \ 
h * Aq = Aq} and Zq = {h E Hq \ h * a = a for all a G Aq}. We have the following elementary 
lemma (c.f. [HelSOl, LIO, 4.5]) 

Lemma 4.1. (1) N^ = {h E Nho{Ao) \ (3{h) E Aq}. 

(2) For h E Hq, f3{h) E Aq if and only if there is an s E Aq such that s~^h E Kq, in which 
case s^ = [3{h). 

(3) For h E Hq, h E Nq if and only if hAoKo = AqKq and h E Zq if and only ifhaKo = oKq 
for all a E Aq. 

(4) If h E N^, let s E Aq such that hKo = sKq. Then haKo = [h* a)s~^KQ = hah^^sKQ 
for all a E Aq. 

Remark 4.2. It follows from Theorem 3.1 that the intersection oi HQ*e and Aq is discrete, hence 
finite. Thus for any h E N^, there are only finitely many possibilities for (3{h). Hence Wq is 
finite since NfjoiAQ) / Zho{Aq) is finite. 

Proposition 4.3. Let h E Hq such that h *Y = Y' where Y , Y' C Aq are nonempty. Then 
there is a w E Wq such that w *y = h * y for ally eY . 

Proof. Let G^ = {g E Gq\ Ty{g) = g for all y E Y} and define Gq similarly. Then a calculation 
shows that conj(/i)G^ = Gq . Now Aq is maximal a-split in both Gq and Gq , and con}{h~^)AQ 
is maximal a-split in Gq . Thus there is an element g in the identity component of {GqY such 
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that g~^h~^AQ = Aq. Since g G G^ and a{g) = g, it follows that for all y G 1^ we have 
6y{g) = g and hence g * y = y . Thus hg G Nho{Aq) and hg acts on Y in the same way as h. 
Since hg * y ^ Aq and coni[hg)y G Aq for y G F, it follows that /igf G A^q. Hence hg gives the 
requisite element of Wq. D 

Now we consider the case where K is replaced by an open subgroup. Let K' denote an 
open subgroup of K, let K^ denote K' n U and let Xq denote Gq/Kq. We have the Hq- 
equivariant covering map /3: Xq — > Xq. Let Nq = {h G Nho{Ao) \ hAoK'^ = AqK'q}, let 

Z^ = {h e Ho \ haK^ = aK'^ for all a G Aq] and define W^ = N'^/Z'^. Let a[,^^ denote the 

('2') 

elements of Aq of order 2. Then Aq = Aq^ K. There is a natural morphism Wq — > Wq and 
we have 

Lemma 4.4. T/ie canonical mapping Wq -^ Wq has kernel Aq K'q fl Zho{Aq)Kq. The image is 
represented by {h G Nq \ s~^h G K'q for some s G Aq}. 

Corollary 4.5. Let Y , Y' he nonempty subsets of Aq and suppose that h E Hq such that 
hY{K'Q) = Y'{Kq). Then there is a w E Wq such that hy{K'Q) = wy{K'Q) for all y eY. 

Proof. As in the proof of Proposition 4.3 we can find g in the identity component of M := (G'^Y 
such that hg E Nq. We saw that YKq C X^ , hence the elements of the Lie algebra m, 
considered as vector fields on Xq, vanish on YKq. It follows that the elements of m, considered 
as vector fields on Xq, vanish on Y{Kq). Thus g fixes Y{Kq). Hence we may reduce to the 
case that h E Nq. For y E Y we have hy{KQ) = |/'(-ft'o) where y' E Aq. It follows that 
{y')~^hyh"^h E K'q where s := {y')~^hyh~^ E Aq. Thus h induces an element of Wq. D 

From [Mat97, §3] we have 

Theorem 4.6. (1) Gq = HqAqK'q. 

(2) The inclusion AqK'q C Xq induces a homeomorphism {AqK'q)/Wq ^ Xq/Hq. 

Note that Corollary 4.5 is a strengthening of (2) above. 

5. Parameterization of the quotient 

We find it useful to consider the Kempf-Ness set A1 with the orders of the compact and 
noncompact parts reversed. Using (2.14.1) one easily shows 

Proposition 5.1. We have 

M = {exp(OM \uEXq, ^eSuH to}. 

Remark 5.2. The description of Ai shows that Ai fibers over Xq with fiber over u E Xq the 
noncompact part exp(iSu fl x:q)u of the transversal PuU. 

Corollary 5.3. Let x E X such that H * x is closed. Then Tx = OxO' is semisimple so that G^^^ 
is reductive. 

Proof. First assume that x E M., so that x = exp{^)u for u E Xq and ^ G iS„ fl to. It follows 
from Lemma 2.12 that r„ is semisimple, and since ^ E Su, Tm(0 = ■C- Since iC, E u, adz.^ and 
ad^ are semisimple endomorphisms of Uc, hence conj(exp(^)) is a semisimple automorphism of 
Uc commuting with r^. Thus r^. = conj(exp(^))r„ is semisimple. 

Now suppose that h E H and x E M.. Then one computes that Th^x = conj(/i)r2; conj(/i~^), 
so Tht^x is semisimple. D 

Lemma 5.4. Let u E Aq and let A be a 5-stable {a, 6u) -split torus. Then Au C M.. 
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Proof. We may write A = BC where i? is a 5-split torus and C is (5-fixed, both tori being 
cr-spht. Let h = exp(Z) G B and c ^ C. Since be is ^^-spht, it follows that both b and c are 
6'ti-split, so that Z is 6'cu-split. Hence Z G Scu H to and bcu E Ai. D 

Remark 5.5. li Z E to, then ad Z acts on q with real eigenvalues, hence an element of q is fixed 
by Ad(exp(Z)) if and only if it is annihilated by adZ. 

We now give a small subset of M. mapping onto the quotient X//H. 

Theorem 5.6. There are points ui,...,Us G Aq and maximal {a,6ui)-split 6-stable tori Ai 
sueh that every elosed H -orbit in X intersects UAjMj. Moreover, every principal orbit intersects 
exactly one of the AiUi. 

Proof. Let x G A^, so that x = exp{Z)u where u E Xq and Z G 5^ fl to. Theorem 4.6 allows 
us to assume that u E Aq. Now the transversal at u is PuU where Pu is the symmetric space 
associated to G^^^ and a. We have the transversal QxX at x for the action of Hu on PuU. Then 

TeiQ.) = {Ye g(") I a{Y) = 9,{Y) = -¥} 

= {F G 5J Ad(exp(Z))r = Y} = {YeSu\ [Z, Y] = 0}. 

If x is principal, then exp(Z) is principal for the action of Hu on Pu, hence Qx has to be a 
maximal {a,6u)-sp\it torus A in G. By construction, A is 5-stable, hence Au C A4. Now we 
have exp(Z) G A and x G Au. We have shown that the principal orbits intersect a union UAiUi, 
but we do not yet know that finitely many AiUi suffice. 

Now suppose that we have AiUi and A2U2 where ui, ^2 G Aq and the A^ are (5-stable maximal 
(a, 6'„.)-split tori in X, i = 1, 2. Suppose that there are principal points Xi := UiUi and an 
h E Hq such that h*xi = X2. Since xi is principal, Pri is a maximal (a, 6'2;i)-split torus. But Ai 
is cr-split and 6'a:^-split (since ai G Ai), so Pr^ = Ai and for the same reason, P^^ = ^2- Then 
Proposition 3.4 shows that conj(/i)Ai = A2 and hence h * AiUi = A2U2. Thus the principal 
points oi M./ Hq are the image of the disjoint union of the principal points of sets AiUi. Moreover, 
the principal points of the AiUi have open image in Ai/Ho, so that each irreducible component 
of the principal points of Ai/Ho lies in the image of a single AjMj. Now the principal points of 
Ai/Hf) are a semialgebraic subset of Ai/ Hq, so that there are finitely many components. Hence 
we only need a finite number of AiUi. Since the set of principal orbits is open and dense in X, 
the same is true for A^. It follows that Hq * UiAiUi = AI. Hence every closed if -orbit in X 
contains a point of UiAiUi. D 

Definition 5.7. Let A^ be maximal (a, ^^ J -split tori where Ui G ^O) i = 1, 2. We say that 
AiUi and A2U2 are equivalent if there is an /i G -ff such that h * AiUi = A2U2. Equiva- 
lently, conj(/i)yli = A2 and h * ui E A2U2. We define the Weyl group W^{AiUi) to be 
N^{AiUi) / Z^{AiUi) where the * just reinforces the fact that H is acting via * and not by 
conjugation. 

Remark 5.8. If n = e, then W^{Au) = W^{A) is the usual (twisted) Weyl group of A. 

We saw above that whenever AiUi and A2U2 have images in X//H with a common principal 
point, then they are equivalent by an element of Hq. The self equivalences of AiUi are just 
W*h{A^u,). 

Example 5.9. Here Uc = SL(2,C), U = SU(2, C) and G = SL2(M). We have the involution 6 
which is conjugation with (1 J) and the involution a which is conjugation with (J -°i)- Then 
T = 6a is conjugation with v := ( ? 'g^ ) and a6 is conjugation with —v, so that a and 6 commute. 
The group ii is {(^/i) | A G M*}, q = {( g) : 6, c G M}, K = {(g ^) | a, beR, a^ - b^ = 1} 
and p = {(_?t J'a) I a, 6 G M}. The Cartan involution 6 of Uc is conjugate inverse transpose. 
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6 commutes with a and 6 and Xq = {{t -a) \ a, b e R}. We have Go = G n U = S0(2,M) = 
Ao = Xo and X := Pe{G) = { ( ^w) \ad + }? = 1}. The element [^ ^^,) e H sends ( _"f, ^) to 
( -fe' A-2^)- '^'^^^ -^0 = {=t-^} acts trivially on X so that X/i7 ~ M and the orbits of H are 
connected. 

Use coordinates x = h, y = {a + d)/2 and z = (a — (i)/2 on X. In these coordinates, X is just 
the hyperboloid in 3-space given by the equation x^ + y'^ = 1 + z^ . The action of H fixes x and 
on y and 2 it is given by matrices {( ^ „) | a^ — 6^ = 1, a > 0}. Now consider the intersection 
X n {x = c} for c fixed. 

(1) If c^ 7^ 1, then X fl {x = c} is the hyperbola y^ — z^ = 1 — c^, each of whose branches 
is an if -orbit. If 1 — c^ > (resp. 1 — c^ < 0), then the ilf-orbit contains a unique point 
where z = (resp. y = 0). 

(2) If c^ = 1, then X n {x = c} is the union of the two lines {{x,y,z) = {c,s,s)} and 
{{x,y,z) = (c, s,— s)} where s G M. There are two ff -fixed points (±1,0,0) and eight 
non-closed ii^-orbits {(±1, ±s, ±s) | s > 0}. 

Set M := {{x,y, z) & X \ y = or z = 0} which is the union of Aq = Xq and the hyperbola 
{x^ — z'^ = 1, y = 0}. From the above, each closed if -orbit intersects M in a unique point. We 
show that M = M. 

Let u G Aq. From Remark 5.2 the fiber of 7V1 over u is exp(5„ fl Xo)u. If (° g) G q lies in 
Su, then it is fixed by r^ which is conjugation with uv. For u ^ ±v, conjugation by uv fixes 
only the Lie algebra {( _°„ g)} of ^o- Thus iS„ fl to = {0} and the fiber of Ai over u is just the 
point u. Now suppose that u = ±v. Then mw acts trivially on q, so that iS„ fl to = {(„ o)} 
whose exponential is the torus A := K^ = {it a) \ ^"^ ~ ^"^ ~ ^ ^^'^ ^ ^ 0}- Thus the fiber 
of M above each point ±v is the translated torus A{±v) which, viewed in our coordinates on 
X, is the branch of {x"^ — z"^ = 1, y = 0} through v. Hence M = A4. Note that the principal 
points in A1 are just the complement of ±v. The (translated) tori of Theorem 5.6 are Aq, Av 
and A{—v), each with trivial Weyl group. 

5.10. Non-closed orbits. It is possible to classify all the orbits of H on X, not just the closed 
orbits. Let H * y he a. non-closed orbit, and let x be a closed orbit in the closure oi H * y 
(see Theorems 2.16 and 2.17). We may assume that x G A^. Then H * y has to intersect the 
transversal PxX, so we may assume that y G PxX. Recall that G^^^ is reductive (Corollary 5.3). 
Now it is well-known that the non-closed orbits for the action of H^ on P^ are the nontrivial 
unipotent orbits, i.e., those consisting of unipotent elements of G'^^^ [Ric82]. But the unipotent 
elements are those of the form exp(?T,) where n G iS^^ is a nilpotent element of the semisimple 
part of q'^^\ There are only finitely many ifa,-conjugacy classes of such nilpotent elements, so 
one is reduced to a computation involving symmetric space representations. Hence one can 
compute all the if-orbits on X. In Example 5.9 above, the only points x & M. where the 
slice representation of H^ is nontrivial are the non-principal points v and —v. At v, we have 
G^"^ = G and 9^ = a. Thus 5^ = {( g g ) | a, 6 G M}. The representation oiH^ = H c^R* on S^ 
has weights 2 and —2 of multiplicity one, and the corresponding weight spaces are generated 
by ^2 '■= (oo) and n_2 := (lo), respectively. There are two nontrivial if -orbits in each of 
M • n±2. Thus there are four non-closed orbits in X with closure containing v, as we saw above. 
Similarly, there are four non-closed orbits whose closures contain —v. 

6. Some results on Lie algebras 

In this section only, G will denote a general real reductive Lie group with Cartan involution 6 
commuting with an involution a. We have the Cartan decomposition = 0o©^o where Gq = G^ 
and we have the decomposition g = f) © q relative to a. The groups H and ifo are defined as 
before. 
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Proposition 6.1. Let bo <Z go be a maximal a-split com,m,utative suhalgehra. Let bi C to fl q he 
maxmal ahelian in the centralizer of bo. Then 

(1) b := bo © bi zs maximal abelian in q. 

(2) Let b'l he another choice of bi. Then bi and b'^ are conjugate by an element of the 
connected centralizer of bo in Ho- 

Proof. Part (1) is obvious. For (2) replace G by the connected centralizer of bo and then divide 
by the center. This reduces us to the case that 0o H q = {0}, so that Qo <Z i) and Go = Ho- 
Moreover, bi and b[ are maximal abelian subspaces of q C to. Now bi and b'^ can be extended 
to maximal abelian subspaces of to. But all such subspaces are (G'o)°-conjugate. Since Go = Hq 
preserves q, we see that bi and b'^ are (ifo)°-conjugate. D 

Corollary 6.2. (1) Let bi he as above and set Bq = exp(bo). Then B := i?oexp(bi) is a 
maximal a-split torus in G. 
(2) Let B' he a maximal a-split torus in G such that the maximal compact subgroup of B' 
has the same dimension as Bo- Then B' is (Hq)^ -conjugate to B. 

Proof. Part (1) is immediate from Proposition 6.1. As for (2), we may assume that B' is 5- 
stable [OM80, Remark after Lemma 5]. Then we may decompose B' as (-B' fl ?7) x {B' fl i?o) 
where Rq = exp(ro). Since B' CiU has the same dimension as Bo, we know that B' {~\U and Bq 
are (ifo)°-conjugate. Thus we may assume that B' (1 U = Bo- By Proposition 6.1 there is an 
element of (Ho)^ which centralizes Bq and conjugates B' fl Ro into B (1 Rq. □ 

If m and n are subalgebras of g, we denote by m" the centralizer of n in m. 

Lemma 6.3. The suhalgehra q*^ lies in the center of q. 

Proof. We may reduce to the case that g is semisimple. Restricting a to q^ we obtain that 
Q^ = (P)'' = Z{i))) © q^. If a is a maximal commutative subalgebra of q*', then exp(Z([))) applied 
to a generates the vector space q''. Since the action of i) is trivial on a, we must have that 
a = q^ i.e., q^ is abelian. Since f) is reductive, we have an f)-module decomposition q = q'' © q' 
for some [)-module q'. Let a be a maximal abelian subspace of q containing q''. Then a = q''©a' 
where a' C q'. Again we have the fact that exp(P)) ■ a' has to generate q'. But then it follows 
that every element of q' commutes with q^ Thus q'' centralizes q. Since I) obviously commutes 
with q^, we have shown that q^ C Z{g). D 

7. Stratification and Weyl groups 

We have the stratification of Ao coming from the conjugacy class of the iJ-isotropy group. 
So a and b are in the same stratum if and only if Ha is conjugate to Hh. Another way to think 
of this is to map Ao into X//H and pull back the stratification of X//H by isotropy type. We 
refine this stratification by taking connected components of the strata. Since the isotropy type 
stratification is locally finite, it is finite when restricted to Aq. 

We will show that if 5" is a stratum, then the translated tori An, where A is maximal (a, 
^„)-split and u E S, are independent of u. Moreover, if S*! fl 5*2 7^ where the Si are strata, 
then the tori for u E Si are included in those for u E S2. Thus if one wants to find the maximal 
tori of Theorem 5.6, one needs to only consider those Si which are minimal, i.e., closed. On the 
other hand, we show that to every stratum S there is associated at most one Au, and a subset 
of these tori gives a collection as in Theorem 5.6. Later we will see that we can determine the 
strata of Ao using a Weyl group. 

If u G v4o, let y4o,n denote (y4o°''''^^"'*)°. The stratum X^^") of X corresponding to Hu is 
{x E X \ H^g is conjugate to Hu where H * xo (Z H * x is closed}. Restricted to Aq the stratum 
is just those points with isotropy group conjugate to H^. 
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Lemma 7.1. Let u E Aq. Then X^^^^ fl Aq is contained in a finite union UiAo^UiUi- 

Proof. The fixed point set Aq " for tfie *-action is just A^'^ " n. If a point u' E Aq is H- 
conjugate to a point of A'^^ " u, then it is PFo*-conjugate, so that we get a finite union covering 
Xi"^) n Aq as claimed. D 

Since only finitely many strata intersect Aq we have 

Corollary 7.2. There is a finite WQ-stable collection {AouiUi} with the following properties. 

(1) For i j^ j, Ao,uiUi ^ Aq^^jUj. 

(2) If u E Aq, then u E Ao^^iUi for some i where if„- = Hu. 

Now for a fixed i, let Vi denote the union of the AquUj such that if„- is properly included in 
Huj. Then Tj := AQ^uiUi\Vi is Zariski open and dense in Ao^^iUi and is the set of points of Ao^^iUi 
whose isotropy group is if^.. Now define the strata of Aq to be the connected components of 
the Tj. 

Proposition 7.3. Let u E Aq and let S be the stratum containing u. Then for u' E S we have 
Hu = Hu', Pu = Pu' and P^u = Pu'u' . 

Proof. We have u' = au for some a E Aq^^- By definition, H^ = H^i. Now the slice representation 
of Hu is its action on Su = g*-"^ fl q. Moreover, g*^"^ fl 1) is the Lie algebra of Hu- Since Pu is 
determined by g^^\ we see that P„ is determined by the slice representation at u. But slice 
representations are constant, up to isomorphism, along connected components of isotropy strata. 
By Lemma 6.3 applied to the action of a on g^^^ we obtain that (g^"))^" fl q lies in the center 
of g("). It follows that Aq^u centralizes g^") so that g^"') D g^"). Thus g^^'^ = fl(") and P„ = Pu'. 
Since Aq^u centralizes q^'^\ it acts as translations on P„. Thus PuU = Pu'u' . D 

Corollary 7.4. Let S he a stratum of Aq. Then {Au: A is maximal (cr, 6u) -split} is independent 
of u E S . 

Definition 7.5. We say that a maximal (a, ^^j)-split and 5-stable torus A is standard ii Ar\U C 

Aq. 

Proposition 7.6. Let A he maximal {a, 6u) -split where u E Aq. Then there is an h E Hq such 
that h * Au is standard. 

Proof. The torus A is maximal a-split in G^^\ and it follows from [OM80, Remark after Lemma 
5] that we may conjugate A by an element of {{Hq)u)^ such that it becomes (5-stable. So we 
may assume that A is 5-stable. Write A = BC where i? is a 5-split torus and C is a compact 
torus. By Theorem 3.1, the intersection of any orbit Hq * cu with Cu is finite, c E C. Thus the 
dimension of the intersection of Hq * Cu with Aq is the dimension of C. Hence there is a stratum 
S of Aq of dimension at least dim C such that the orbit of an open subset of Cu intersects S. 
Now pick a cu in the open set. We can also assume that there is a.h E B such that hcu is a 
principal point of Au. Thus we can reduce to the case that u lies in a stratum S of dimension 
at least dimC and that there is a principal point x := bu, b = exp(Z) E B where Z E SuC] Vq. 
From the proof of 5.6 we see that the Lie algebra of the unique (a, ^2:)-split maximal torus 
through X is {Y E Su \ [Z,Y] = 0}, which is, of course, a. Now ii a E Aq and au E S, we 
know that dau{Z) = —Z and that OuiZ) = —Z. Thus a centralizes Z so that au E Cu since S 
is connected. But dimS' > dimC. Hence a neighborhood of the identity in C lies in Aq. Hence 
C G Aq so that A is standard. D 

Proposition 7.7. Let S be a stratum of Aq whose closure intersects the stratum T. Let u E S 
and let A be a maximally {a, 9u)-split torus in X . Then A is {a, 6i,)-split for v E T. 



12 ALOYSIUS G. HELMINCK AND GERALD W. SCHWARZ 

Proof. By Corollary 7.4 we may assume that t; G T is in the closure of S. Then clearly A is 
6'^-split. n 

Corollary 7.8. Let Si, . . . , Sr be the closed strata of Aq and consider a pair {A, u) where u & Aq 
and A is a maximal (a, 9y)-split torus. Then for some v G UiSi, A is maximal (cr, 6^)-split. 

If one only wants to find the maximal tori (appropriately split), then one only has to look 
at the minimal strata. One also only has to look at standard tori. However, this is not an 
algorithm. We give an algorithm after Proposition 7.16 below. 

From Remark 5.2 we have an i^o-eQuivariant projection tt: A^ — >■ Xq, exp{^)u i— >■ u. Let ttq 
denote the induced mapping from 'n'~^[Ao) — > A^. From Theorem 4.6 we have an isomorphism 
Xq/Hq ^ Aq/Wq. Let p: Aq ^ Aq/Wq be the quotient mapping. Then from our isomorphism 
and 71 we obtain a surjection 7: M./Hq -^ Aq/Wq. We show that ttq and 7 are product bundles 
over appropriate strata. 

Theorem 7.9. Let S be a stratum of Aq and let u E S. Then, over S, ttq is a product bundle 
S X exp(5'u n to) ^ S* and, over p{S), '-y is a product bundle p{S) x exp(5u fl ro)/(-f^o)u -^ p{S). 

Proof. From the description of Ai (Proposition 5.1) and Proposition 7.3 we see that tTq (S) ~ 
S X exp(5„ n to). Thus ttq is a trivial bundle over 5". Now let exp(Zi)Mi, exp(Z2)M2 G 7rQ^{S) 
where ui, U2 E S and Zi, Z2 E Su^i to- Suppose that h E Hq and h * exp(Zi)Mi = exp{Z2)u2- 
Then h*ui = U2, so there is an h' G A'^^ such that h' * Ui = U2. Note that, since Wq permutes 
the strata, h' * S = S. Then {h')~^h fixes Mi, hence it fixes all the points of S. Let Wg denote 
the elements of Wq which send S into itself modulo the elements fixing S. Then Wg acts freely 
on S and p{S) - S/W^ Moreover, T^{p{S)) - p{S) x exp(5„ n to)/{Ho)u- □ 

Now consider u E S and the group Gi which is the fixed group of aS acting on G^'^\ Then Gi is 
reductive with Cartan involution 6, and one easily sees that we have the Cartan decomposition 
Gi ^ {HQ)uexp{Su n to). Let t be a maximal abelian subspace of iS„ fl to and let W{S,i) 
denote the associated Weyl group (the normalizer of t in {Hq)u divided by the corresponding 
centralizer) . Then exp(5u fl ro)/(i?o)w — exp(t)/iy(S', t) (see, for example, [HelSOl, Theorem 
11.11]). We call W{S,i) the Weyl group of S and i. It is independent of u G S* and the choice 
of t, up to isomorphism (see 6.1). 

Corollary 7.10. Let S be a stratum of Aq, u E S, and let t be a maximal toral subalgebra of 
5„ n ro- Then the fibers of •y above p{S) are isomorphic to exp{i)/W{S, t). 

We now have the result that if-conjugacy is the same as i/o-conjugacy for translated tori. 

Theorem 7.11. Let Ai be maximal {a, 9^^)- split tori, i = 1, 2. Let h E H such that h* AiUi = 
A2U2. Then there is an h' G Hq such that h' * AiUi = A2U2. 

Proof. We can assume that the AiUi are standard. Since h* Ui E Ai, there is an hi E Hq such 
that h * Ui = hi * Ui. Thus h * Ui E A2U2 fl U , hence h * Ui = a2U2 where 02 G A2 fl f/ C Aq. 
Now conj(/i) must send the maximal compact subgroup AiPiU oi Ai to A2 fl U, so that 
h * {AiUi nU) = A2U2 n U. Write h = exp{Y)ho where ho E Hq and Y E i) n to. Then by 
uniqueness of the Cartan decomposition one obtains that h* = ho* on AiUi fl U. Thus we 
may assume that h* is the identity on AiUi fl U. Then the projections of ai and 02 to q fl to 
are maximally a-split subalgebras commuting with ai fl Oq. By Proposition 6.1 there is an 
h' E ((iJo)Mi)° centralizing Ai fl Ao such that Ad(/i')ai = 02. □ 

Remark 7.12. In the last line of the proof above, h' E (-f^o)«i already implies that h' fixes all of 
the stratum S containing ui, hence that it centralizes Ai fl Ao (which is generated by Sui^). 

From Corollary 4.5 we obtain 
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Corollary 7.13. Let the AiUi be standard maximal {a,dui)-split tori, i = 1, 2. Then AiUi and 
A2U2 are equivalent if and only if there is aw & W^ such that w * {AiUi fl Aq) = A2U2 fl Aq. 

Corollary 7.14. Let A be maximal [a, 6u) -split where u ^ Aq. Then W^{Au) is finite 

Proof. We may assume that Au is standard. Let h G W^^{Au) = W^{Au). Modifying h by 
an element of Wq we may assume that h is the identity on Au fl Aq. Then the projection t of 
a to Su n to is maximal abelian and h induces an element of W{S, t) where S is the stratum 
containing u. Thus W^{Au) is finite. D 

Corollary 7.15. Let the AiUi he as in Theorem 5.6. Then for each i the mapping from the 
principal points of AiUi to X//H is the quotient by a free action ofW^ {AiUi). 

Proposition 7.16. Let Au be a standard maximal {a,6u)-split torus. Let B denote ACiAq. Let 
S be a stratum of Aq such that BuCl S has the same dimension as S. Then, up to equivalence, 
Au is determined by S . 

Proof. We may assume that u & S. Now a fl to is maximal cr-split in Su H to. By Corollary 6.2 
and Remark 7.12, aflro is unique, up to the action of {Hq)^. Since AflAo is generated by Su~^, 
A is determined by S, up to equivalence. D 

Now we give an algorithm to find a minimal collection of standard tori AiUi whose images 
cover X//H. Let Si,...,Sr be strata of Aq such that the strata of Aq/Wq are the p{Si). 
Let S be one of the Si and let u ^ S. Let t be a maximal toral subalgebra in iS„ fl to. If 
dimt+ dimS* = diniX//H, then let C be the connected subtorus of Aq generated by Su~^ and 
let B denote exp(t). Then A := BC is a maximal (a, 6'u)-split torus and we add Au to our 
collection. If dimt+ dim 5* < dimX/i7 do not add anything. By Proposition 7.16 we obtain a 
set {AiUi = BiCiUi} whose images cover X//H. Now it is only a matter of removing one of any 
pair of tori AiUi and AjUj whenever CiUi and CjUj are carried one to the other by an element 
of Wq. Thus we obtain a minimal collection as in Theorem 5.6. 

Remark 7.17. Let 5*1, . . . , 5*^ be the open strata of Aq and let A be a maximal standard {a,9)-split 
torus containing Aq. Then, up to equivalence, AiUi = ■ ■ ■ = ApUp = A. 

Example 7.18. We revisit Example 5.9. Let n = {^^''^) e Aq = S0(2). Since ( q a° 1 ) ^ ^ 
sends m to ( '^^ a-^^) , the isotropy group of if at m is ±1 for u 7^ ±v and H ior u = ±v. Thus 
the strata of Aq are the two points ±v and the two connected components of Aq \ {±f }. Since 
Wq is trivial, these are also the strata of Aq/Wq. The maximal (cr,^)-split torus Aq comes from 
the open strata and the translated tori {(^ ^) | a^ — 6^ = 1, a > 0}{±v) correspond to the two 
closed strata. 

8. When K y^ G^ 

Let K' be an open subgroup oi K = G^ and let (3: X' = G/K' ^ X he the corresponding 
cover. Let Ai' denote (3~^{Ai). We show that Ai' can serve as a Kempf-Ness set for the 
if -action on X'. 

Lemma 8.1. Let x E X' . Then the orbit Hx is closed if and only if it intersects Ai' . 

Proof. If X G Ai', then the if-orbits in the closed set (3~^{H(3{x)) are open and closed, hence 
Hx is closed. Conversely, if Hx is closed, then H(3{x) intersects M., so that Hx intersects 
M'. D 

Lemma 8.2. Let x G X' . Then Hx fl TW is a single HQ-orbit. 
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Proof. Since Hq acts transitively on the connected components of H, we can reduce to the case 
that H is connected. For y & X, let f{y) denote the norm squared of iJ,{y) using the invariant 
inner product B of Lemma 2.12, and consider the flow ipt on X which is the negative of the 
gradient of /. (We can use the inner product on X induced by the Kahler form on Uc §2.13.) 
Then ijj is a. flow along if -orbits and it is i^o-equivariant. Moreover, since all our data is real 
analytic, the flow extends to -|-cxo to give a deformation retraction of X onto M (see [Sch88] 
and [HSt07]). Now the flow lifts to X' to give a deformation retraction tp'^ of X' onto Ai'. If 
X G X', then ip'^{Hx) is connected. We know that the lemma holds for (3{x) in place of x, so 
that Hx n M is a finite union of iiTo-orbits which cover Hj3{x) fl M.. But connectedness now 
implies that there is only one iio-orbit. D 

Corollary 8.3. The analogues of Theorems 2.16 and 2.17 hold for X' and M.' and we have a 
quotient X' // H . 

Let Xq denote Gq/K'q where Kq = K' n U. Then /3: Xq — > Xq is a cover of the same degree 
as X' — s> X. Then one easily shows 

Corollary 8.4. M' = {exp{Z)v \ v e Xq and Z G >S/3(„) H to}. 

Remark 8.5. Let v, v' e AqK'q, let Z G Sp(v) fl to and let Z' G Sp{v') fl to. Then exp(Z)f_ft'' = 
exp(Z')v'ii'' if and only if Z = Z' and v = v' . 

Let 5 be a stratum of Aq, and let S' denote j3~^{S) fl AqA'q. Then S" = U^=i'S'j where the S'j 
are connected and are covering spaces of S. Let u E S and h G {Hu)v, v G S'j for some j. Then 
h preserves S'^ and if h does not act trivially on S'j, then, since S'^ — i> S* is an (iiM)^-equi variant 
cover, it follows that h acts nontrivially on 5, a contradiction. Thus {Hu)v acts trivially on 
5"^ and is independent of w G Sj, so that we can use Us Uj S'j as strata for AqK'q. Let A be 
(a, 6'^(„))-split and (5-stable where v G AqK'q. We say that Av (or A) is standard ii AnU G Aq. 
Then as in Proposition 7.6 one shows that for every maximal (a, /?(w))-split torus A, v E AqK'q, 
there is an /i G -ffo such that /lAf = hAh~^hv is standard. 

Let vr': A^' — > Xq be the canonical map, and let tTq: {ti')'^ {AoK'^^) — > Aq-R'o tie the induced 
mapping. Let 7' be the canonical mapping of TW' — >• X'q/Hq ~ (Ao/'i'o)/^o ^^'^ ^^^ P'- ^0-^0 "*■ 
AqK'q/Wq be the quotient mapping. Then we have the analogue of Theorem 7.9: 

Theorem 8.6. Let S' be a stratum of AqK'q and letv G S' . Then, over S' , vTq is a product bundle 
S' X exp(S'^(„) rito) — > S' and, over p\S'), 'j is a product bundle p'{S') x exp(iS^(^) nro)/(-f/^o)v -^ 
p\S'). 

There is also clearly the analogue of Corollary 7.10, whose statement we omit. For A maximal 
(cr, /3(v))-split, let W'fj{Av) denote the group of automorphisms of Av coming from elements of 
H, and define W^^{Av) similarly. Then the obvious analogues of Theorem 7.11 and Corollary 
7.13 hold and the group W'^iAv) = W^^^{Av) is finite. 

If one wants to find translated tori Av which minimally cover X'//H, then one can proceed 
as before (discussion after Proposition 7.16). Here is another method. Let Au be one of the 
maximal tori occurring in Theorem 5.6. We can assume that it is standard. It is covered by tori 
Avj where P{vj) = u, Vj G AqK'. Let Wq^ denote the subgroup of Wq whose image in Wq fixes 
{A n Aq)u. Then W^^ acts on /3~^(u) fl AqK' and one chooses a maximal subcoUection of the 
Avj where the Vj are on disjoint W^ „ orbits. Then starting with a minimal collection AiUi as 
in Theorem 5.6 one arrives at a minimal collection AiVij which surjects onto Ai' / Hq ~ X' //H . 

9. Stratification via a Weyl group 

Now we would like to compare our stratification of Aq with that given by a Weyl group. It 
turns out that W^{Aq) = Wq is not large enough for our purposes (see Example 10.1 below). 
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Thus we have to consider the action of the Weyl group W := W^ (Aq) where He is the Zariski 
closure of H in Uc. Since e E Ai, the orbits H * e and H^ * e are closed and the argument of 
Remark 4.2 shows that W is finite. 

Proposition 9.1. Let {Si} be the set of connected H -isotropy type strata of Aq and let {Tj} be 
the connected strata for the action ofW = W^ (Aq). Then {Tj} is a refinement of {Si}, i.e., 
every Si is a union of some of the Tj . 

Proof. Let u E Aq. We have to show that the stratum of Aq containing u for the if -isotropy 
stratification contains the corresponding stratum for the ly-isotropy stratification near the point 
u. We can consider everything in the transversal at the point u, so we replace G by G^"-*, Uq 
by Uq^ and He by He fl U^ . Thus we may assume that u = e and that a = 9. Now the 
complexification Ac of A is a maximal a-split torus in Uc- The subgroup We of W is generated 
by elements of He which preserve Aq under conjugation. Near e, the stratum of H is Bi where 
Bi := {b e Ao\ H ■b = b} and the stratum of We is B2 where B2 := {b E Aq \ We ■ b = b}. We 
need to show that B2 G B^. 

Consider B2 and let a: Aq ^ S^ he a. root of the Ao-action on g. Let Aq G A where A is 
maximal a-split in G. We show that there is an element of We which sends a to a~^, as follows. 
The root a is the restriction to Aq of a root of A and a root of the complexification Ac, which 
we will also call a. Let (Ac) a be the kernel of a and consider the centralizer of (Ac) a in Uc 
divided by {Ac)a- Call this group C. Then C has maximal cr-split torus Ac/{Ac)a, and the 
roots of this torus acting on c are multiples of a. Then there is a c G (C fl Hc)^ which acts 
as inverse on Ac/{Ac)a — C* [Ric82]. Thus c gives us an element of We which fixes (Ao)q, and 
acts as inverse on Aq/^Aq)^,. It follows that B2 G Kera. Since a is an arbitrary root of Aq, we 
find that B^ centralizes Uc, hence B2 is fixed by H^. li h G H, then h sends A to a maximal 
cr-split subtorus coni{h)A of G. Since A is maximally compact, by Corollary 6.2 there is an 
element of [Hq)^ which when composed with h stabilizes A. Thus, modulo H^ (which fixes B2), 
we may assume that h G Nh{A). Thus h preserves Aq and it acts on B2 as an element of We, 
i.e., trivially. Thus B^ G B^ D 

If K' is an open subgroup of K, then define W' := W'f^^{AQKQ) as the subgroup of He 
stabilizing AqK'q divided by the subgroup centralizing AqK'q. Then W' is finite since W' -^ W 
has finite kernel and W is finite. 

Corollary 9.2. Let {S^} be the set of connected H -isotropy type strata of AqK'q and let {T'A 
be the connected strata for the action ofW'. Then {T'} is a refinement of {S'i}, i.e., every S'i 
is a union of some of the Tj. 

Proof. Let v G AqK'q and set u = (3{v). Set Ci = {AqK[,)"^ and G2 = {AqK[,)^^. We need to 
show that C^ G C^. By Proposition 9.1 we have that B^ G Bf where B2 = Ajf" and Bi = A^". 
Note that [Hu '■ H^] is finite and that C° = {B^ '')^Kq. We have the analogous result for Cg. 
li h G {Hu)^, then h fixes v and i?2- Clearly every element of H^/{Hu)^ is represented by an 
element normalizing Aq. Thus H^ acts trivially on ((i?2-K'o)^")° — ^2 so that C2 G C^. D 

10. Some examples 

Example 10.1. . We reexamine Example 5.9, 7.18 using the Weyl group. The group Wq is 
trivial, but W^^{Aq) is generated by the element (0 -i) which acts on Aq by sending {^ba) 
to {zl \)- The fixed points of this action are {±t'}) hence we obtain again the isotropy type 
stratification of H. 

Example 10.2. Suppose that Aq = {e}. By 6.2 there is only one (iJo)'^-conjugacy class of 
maximal (cr,6')-split tori in G. Thus M. = Hq*A where A is maximal (cr,6')-split. The argument 
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of Proposition 4.3 shows that M/Hq ~ A/W^^{A) ~ X//H. Now suppose that a and 9 
commute. Then for h G N^^[A), i3{h) G A is an element of order 2, hence it is trivial. Thus 
^Hoi^) — ^Mo(^) is ^^ ordinary Weyl group where Mq = HqH Kq. This agrees with [HelSOl, 
11.11] where it is assumed that ^ is a Cartan involution. 

Now suppose that every maximal (cr,^)-split torus in G is compact. Then again there is only 
one (Hq)^- conjugacy class of maximal (o",6')-split tori and we have X//H ^ A/W^^{A) where 
A is maximal (cr,^)-split. This agrees with the case G compact §4. 

Example 10.3. Here is a case where Aq is of dimension two and the group Wq is large. Let 
Uc = SL(8,C), U = SU(8, C) and G = SL(8,M). Let 6 be the associated Cartan involution 
g I— > *(7~^, g & G. Then Gq = S0(8,M). The Lie algebra to consists of the symmetric real 
matrices. Let 9 he 5 followed by conjugation with ( i*/ o) ^^^ let a be conjugation with ( o -/) 
where / is 4 x 4. Then a, 9 and 6 commute. The group H is the set of real matrices ( ^ ^ ) such 
that det AB = 1, and being in Ho adds the condition that A and B are orthogonal. The group 
K is a copy of Sp(8,]R). The dimension of the quotient of G by iJ and K is the dimension 

of the quotient of p n q by the action of M = H Ci K. Now M consists of matrices ( q * -i ) 

where g G GL(4, M) and pnq = {(^^)|/l and B are skew symmetric}. The representation of 
GL(4, M) is isomorphic to that on A^M'^©A^(M^)* which gives us that the quotient has dimension 
2. 



Let J denote {\ J ) . Then 
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is a maximal (o",6')-split torus (since its dimension is 2) which is compact. Let 0(771,772) denote 
the element of Aq as above with a + ib = e**'^ and a' + ib' = e*^^. Now we compute Wq. If 

(q °) G Hq, then it acts on an element a G Aq sending it to (^ °) a ( '^ °t j. First suppose 

that g = (0/) and h = (q?) where a = (ij). Then (q°) sends 0(771,772) to a(— 771,772). If 
we have g = ( q ? ) and h = {~q ^j), then a{r]i, 7/2) is sent to a(— 771 + tt, 7/2). Thus Wq contains 
the translation 0(771,772) 1—^ 0(7/1 + '^,V2)- Of course we have elements of Wq which do similar 
things to 7/2 while leaving 7/1 fixed. Finally, let (7 = /i = (5 q)- Then the action of this element 
interchanges 7/1 and 7/2. Thus we see that Wq contains the semidirect product 1^(62) ix (Z/2Z)^ 
where 1^(62) is the Weyl group of type B2 and (Z/2Z)^ consists of the pure translations in 
Wq. We claim that W^^^Aq) is no bigger than this. Now the set of pure translations (Z/2Z)^ 
is as large as possible (the pure translations have to be of order 2 [HelSOl, 1.9]). Thus the 
remaining elements of W^ (Aq) fix e G Aq, i.e., they are fixed by 9. Moreover, the Weyl 
group has representatives which are in U, so that we are reduced to calculating M/Mnc/(^o)- 
Now M n U = {(^Q ^ Ifl'^ U(4, C), detg = ±1}. A matrix calculation now shows that 
one cannot obtain elements of the Weyl group of Aq that we have not already seen. Thus 
W^^{Aq) = W^ ~ 1^(62) X (Z/2Z)2. 

Now a fundamental domain D for the action of Wq on Aq consists of the elements 0(7/1, 7/2) 
where < 7/1 < 7/2 < 7r/2. Since Wh^^IAq) = Wq, the strata for the action of Wq and H are the 
same. We now list the various strata 5* occurring in D. 

Case 1:5"= {0(7/1, 7/2) | < 7/1 < 7/2 < vr/2} is the only two-dimensional stratum. The preimage 
of 5* in the quotient X//H is just a copy of S. 

Case 2: S = {0(7/1,7/2) | < 7/1 = 7/2 < 7r/2}. Here the preimages of points of S are one- 
dimensional. Let a E S. Then (i/o)a = {{0 g) Ifi'is orthogonal and gJ2g~^ = J2} where 
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</2 = ( j) gives a complex structure on M"^. Thus (-f^o)a — U(2, C). This group acts on Sa fl to 
which consists of matrices (J^* q*) where C is skew symmetric and J2C = — CJ2. This set of 
matrices is a complex vector space of dimension 2, and we have the standard action of U(2, C) 
on C^. The Lie algebra t of a maximal torus in exp(5a fl to) is generated by ( J)^ ^) where 
C = ( _°a ) ^^d a = ( 5 )• Note that t is stable under the action of (VFo*)a — ^/2Z (generated 
by the element reversing the order of 771 and 772), and the action is multiplication by —1. We 
have W{S,i) ~ Z/2Z, and exp(5„ n Xo)/{Ho)a ^ M>7(^/2Z) where the Weyl group action 
sends r G M?'^ to 1/r. Thus the preimage of 5* is isomorphic to 5 x {r G M | r > 1}. 

Case 3: S = {0(0,772) | < 772 < 7r/2} or S = {?7i,7r/2) | < ?7i < 7r/2}. As above, a maximal 
abelian subspace t C 5a fl to has dimension 1 and W{S, t) ~ Z/2Z. The fiber above any point 
a G S* is isomorphic to {r G M | 1 < r}. 

Case 4: S = {e = a(0,0)}. From our calculations above we have that {Hq)^ = Hq{~\ Kq = 
{ ( 3 ) I ^ is orthogonal} and that iSe fl to = p fl q fl to = { ( JJ^ g ) I C* is skew symmetric}. Thus 
we have the adjoint representation of 0(4, M). We choose as maximal toral subalgebra t the set 
of matrices 
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Then {Wq)^ ~ 1^(62) — W{S, t) acts on t in the standard way. Exponentiating we get pairs of 
positive real numbers ri and r2 whose normal form under 1^(62) consists of {{ri,r2) | 1 < Ti < 
r2}. This is the preimage of 5*. 

Case 5: S = {a := a(7r/2, 7r/2)}. Here {Ho)a consists of the matrices (q)^) such that g and 
h are orthogonal and commute with J2. Thus our group is isomorphic to U(2,C) x U(2,C). 
The vector space Sa fl to consists of matrices {^t^) where C anticommutes with J2. This is 
a complex vector space of dimension 4, and (q °) ^i-cts sending C to gCh~^. Thus we have 
the obvious action of U(2,C) x U(2,C) on C^ ®c C^. As maximal toral subalgebra we can 
choose t = {{t^a *()")} where a = (5 J) and ti, ^2 G M. Here (VFq*)" o'^ce again acts on t, but 
not faithfully. The image only contains the element interchanging tia and t2«- One easily 
calculates that W{S,i) ~ 1^(62). Hence exp(5a n ro)/(i/o)a ^ {(ri,r2) G M^ | 1 < ri < rs}. 
This is the same fiber that we saw in Case 4. 

Case 6: S = {a := a(0,7r/2)}. Here the story is slightly different. Again (WQ)a acts on an 
appropriately chosen maximal abelian subspace t C iSaflto where t ^ M^. The image of (WQ)a — 
(Z/2Z)^ in W{S,i) acts as a sign change on one of the coordinates while W{S,i) ^ (Z/2Z)^ 
acts by sign changes of both coordinates. Thus the fiber above a is naturally isomorphic to 
{(r,s) gM^ I r, s> 1}. 
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